iteration-saturation-small-dataset-reorder/legion-cold/1

PDF of Slope Regression

Additional Statistics:

Lower bound Estimate Upper bound
Slope 1.5228 us 1.5708 us 1.6145 us
0.8933964 0.9150059 0.8969744
Mean 1.5126 us 1.5459 us 1.5797 us
Std. Dev. 65.799 ns 87.088 ns 102.86 ns
Median 1.4938 us 1.5476 us 1.5964 us
MAD 52.244 ns 91.780 ns 139.08 ns

Additional Plots:

Understanding this report:

The plot on the left displays the average time per iteration for this benchmark. The shaded region shows the estimated probabilty of an iteration taking a certain amount of time, while the line shows the mean. Click on the plot for a larger view showing the outliers.

The plot on the right shows the linear regression calculated from the measurements. Each point represents a sample, though here it shows the total time for the sample rather than time per iteration. The line is the line of best fit for these measurements.

See the documentation for more details on the additional statistics.

Change Since Previous Benchmark

Additional Statistics:

Lower bound Estimate Upper bound
Change in time +15.924% +19.709% +23.289% (p = 0.00 < 0.05)
Performance has regressed.

Understanding this report:

The plot on the left shows the probability of the function taking a certain amount of time. The red curve represents the saved measurements from the last time this benchmark was run, while the blue curve shows the measurements from this run. The lines represent the mean time per iteration. Click on the plot for a larger view.

The plot on the right shows the two regressions. Again, the red line represents the previous measurement while the blue line shows the current measurement.

See the documentation for more details on the additional statistics.